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Abstract 


Many  different  multi-agent  problems,  such  as  distributed  scheduling  can 
be  formalized  as  distributed  constraint  optimization.  Ordering  the  constraint 
variables  is  an  important  preprocessing  step  of  the  ADOPT  algorithm  [1],  the 
state  of  the  art  method  of  solving  distributed  constraint  optimization  problems 
(DCOP).  Currently  ADOPT  uses  depth- first  search  (DFS)  trees  for  that  pur¬ 
pose.  For  certain  classes  of  tasks  DFS  ordering  does  not  exploit  the  problem 
structure  as  compared  to  pseudo-tree  ordering  [2],  Also  the  variables  are  cur¬ 
rently  ordered  in  a  centralized  manner,  which  requires  global  information  about 
the  problem  structure.  We  present  a  variable  ordering  algorithm,  which  is  both 
decentralized  and  makes  use  of  pseudo-trees,  thus  exploiting  the  problem  struc¬ 
ture  when  possible.  This  allows  to  apply  ADOPT  to  domains,  where  global 
information  is  unavailable,  and  find  solutions  more  efficiently.  The  worst-case 
pseudo-tree  depth  resulting  from  our  algorithm  is  \]2 kn,  where  n  is  the  number 
of  variables,  and  k  is  maximum  block  size  in  constraint  graph.  The  algorithm 
has  space  complexity  of  0(kn )  and  time  complexity  of  0(n+\E\  +  k^n^),  where 
E  is  the  set  of  edges  in  a  constraint  graph. 
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1  Introduction 


The  distributed  constraint  optimization  problem  (DCOP)  [3]  is  increasingly  used 
as  an  underlying  framework  for  modelling  agents  coordination  problems.  Sensor 
networks  [4] ,  distributed  scheduling  [5] ,  military  unmanned  aerial  vehicles  teams 
[6]  all  are  applications,  where  DCOP  is  or  can  be  used  to  coordinate  the  decisions 
of  autonomous  agents. 

DCOP  consists  of  variables,  each  having  its  own  discrete  finite  domain.  Ev¬ 
ery  variable’s  value  is  controlled  by  exactly  one  agent.  Like  the  majority  of  the 
work  in  the  field,  we  assume  that  an  agent  controls  only  one  variable,  although 
the  situation  of  one  agent  controlling  several  variables  is  also  present  in  the 
literature  [7].  The  agents  must  coordinate  in  order  to  minimize  the  global  cost 
function,  which  depends  on  the  variables.  The  cost  function  is  modeled  as  a  set 
of  valued  constraints,  and  every  agent  has  knowledge  only  about  the  constraints 
depending  on  its  variable.  Therefore,  DCOP  is  a  generalization  of  distributed 
constraint  satisfaction  problem  (DisCSP)  [8]. 

Both  DCOP  and  DisCSP  stem  from  the  extensively  studied  constraint  satis¬ 
faction  problem  (CSP)  [9],  and  the  algorithms  to  solve  the  distributed  problems 
are  often  obtained  by  adapting  the  existing  CSP  algorithms  to  work  in  a  decen¬ 
tralized  manner.  Several  additional  factors  should  be  taken  into  account  when 
performing  such  adaptation.  First,  instead  of  a  single  processing  unit,  in  DCOP 
there  are  multiple  processing  units,  thus  it  is  desirable  to  take  advantage  of  this 
increased  computing  power.  Second,  the  usual  assumption  is  that  the  commu¬ 
nication  between  agents  can  be  performed  only  locally,  i.e.  a  message  can  be 
passed  only  between  agents  that  share  a  constraint.  This  imposes  a  requirement 
of  minimizing  the  communication  cost  of  the  algorithm. 

The  connectivity  between  the  agents  can  be  represented  in  form  of  a  con¬ 
straint  graph.  The  vertices  of  the  graph  are  agents,  and  two  agents  have  an 
edge  between  them,  iff  they  share  a  constraint. 

Recently  an  algorithm  for  solving  DCOP,  ADOPT  [1]  was  proposed.  It  per¬ 
forms  a  systematic  backtracking  with  agents  acting  asynchronously.  To  achieve 
that,  the  agents  are  ordered  a  priori  in  a  tree  such  that  the  agents  in  different 
branches  of  the  tree  do  not  share  any  constraints.  ADOPT  itself  does  not  ad¬ 
dress  the  process  of  ordering  and  regards  it  as  a  preprocessing  step.  Currently  a 
centralized  algorithm  that  performs  depth-first  traversal  of  the  constraint  graph, 
is  used  for  that  purpose. 

The  higher  the  agent  is  in  the  tree,  the  higher  priority  it  has  for  choosing  its 
variable  value.  The  agents  in  different  branches  can  act  independently  of  each 
other.  It  is  known  [1]  that  the  performance  of  the  algorithm  crucially  depends 
on  variable  ordering,  thus  making  important  the  task  of  constructing  the  tree. 

It  is  hard  to  find  an  optimal  tree  for  ADOPT  without  actually  solving  the 
DCOP,  given  that  the  variables  may  have  domains  of  different  size,  different 
constraints  may  be  more  or  less  restrictive,  etc.  However,  tree  depth  is  a  good 
approximation  of  the  optimality  criterion,  because  it  captures  both  the  issue  of 
parallelism  -  generally,  the  smaller  the  depth  the  more  branches  the  tree  has; 
and  information  travel  time  -  the  smaller  the  depth  the  shorter  the  path  of  the 
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Figure  1:  7-nodes  chain  constraint  graph.  Dotted  arrows  mark  DFS  tree  order¬ 
ing.  Dashed  arrows  -  pseudo-tree  ordering. 


information  about  variable  assignments  travelling  from  root  to  leaves. 

Finding  the  minimum  depth  DFS  tree  of  the  graph  is  NP-complete  problem, 
so  different  heuristics,  such  as  max-degree  [10],  are  usually  employed  to  obtain 
an  approximate  solution.  Distributed  algorithm  for  constructing  DFS  trees  can 
be  found  in  [11]. 

For  certain  classes  of  tasks,  however,  restricting  the  possible  orderings  to 
DFS  trees  can  have  strong  negative  impact  on  ADOPT  performance  as  com¬ 
pared  to  pseudo-trees  [2].  Consider  for  example  the  collective  choice  of  firing 
positions  by  unmanned  helicopters,  presented  in  [6].  The  constraint  graph  for 
this  task  has  a  chain  structure,  with  every  agent  sharing  constraints  with  its 
left  and  right  neighbors  (Fig.  1).  The  DFS  tree  for  this  graph  has  depth  linear 
in  number  of  variables.  Optimal  pseudo-tree  for  the  same  graph  has  logarith¬ 
mic  depth.  Therefore,  the  former  case  results  in  longer  time  to  find  the  DCOP 
solution  than  the  latter. 

The  centralized  iterative  algorithm  for  constructing  pseudo-trees  was  pre¬ 
sented  in  [2],  and  further  developed  in  [12]  to  strengthen  tree  depth  guarantees. 
It  was  shown  for  certain  classes  of  CSP  to  yield  better  performance  of  the  back¬ 
tracking  algorithm  than  the  DFS  orderings.  Because  of  the  similarity  of  the  CSP 
and  DCOP  problems  and  algorithms,  one  can  expect  similar  results  for  DCOP. 
The  drawback  of  these  methods  is  that  they  need  complete  constraint  graph 
connectivity  information.  This  requirement  does  not  allow  to  apply  ADOPT  to 
domains  in  which  information  about  the  constraint  graph  cannot  be  gathered 
together  and  processed  by  a  single  unit.  Sensor  networks  [6]  is  an  example  of 
such  domain. 

In  this  paper  we  present  an  algorithm  which  is  both  decentralized  and  makes 
use  of  pseudo-trees.  The  former  property  enables  one  to  solve  DCOP  problems 
without  having  to  process  any  global  information,  and  the  latter  increases  the 
efficiency  of  the  solution  search  if  the  problem  structure  allows  it.  Our  algo¬ 
rithm  is  a  decentralized  modification  of  the  general  iterative  algorithm  from  [2] . 
Unlike  [12],  it  takes  into  account  not  only  the  depth  of  the  resulting  pseudo¬ 
tree,  but  also  the  maximum  message  travel  time  from  root  to  leaves  given  the 
local  communication  assumptions.  It  yields  an  optimal  pseudo-tree  in  terms  of 
message  travel  time  for  acyclic  graphs  and  results  in  tree  depth  no  greater  than 
DFS  traversal  for  general  graphs. 


2  Acyclic  Case 

2.1  The  Algorithm 

Suppose  that  the  constraint  graph  X  =<  V,E>  is  acyclic.  Let  all  the  edges 
have  unit  length.  Denote  N  the  set  of  agent  x’s  neighbors.  We  will  use  the 
terms  agent ,  node ,  and  vertice  interchangeably.  We  will  also  substitute  pseudo¬ 
tree  for  tree,  where  it  does  not  cause  confusion  with  DFS  trees.  When  speaking 
of  subgraphs  X(V)  C  V)  =  Xj  C  X,  we  will  assume  that  Ei  contains  all  the 
edges  from  E1  which  pass  between  vertices  from  V)  and  does  not  contain  any 
other  edges. 

Definition  1  For  agent  x  and  Xq  C  X 

AgentDepth(x,  Ao)  =  ma x{(Agent.Depth(xi,  X(Vq  \  x))  +  1,  Mxi  €  Vo  D  N),  0} 

(1) 

Definition  2  For  constraint  graph  X 

GraphDepth(X )  =  min  Agent Depthfx,  X)  (2) 

x£X 

Observe  that  AgentDepth(x,  X)  is  the  maximum  length  of  a  simple  path  in 
X  beginning  in  x. 

The  tree  building  algorithm  is  as  follows.  First,  select  a  node  x\  such  that 
Agent Depth{x\)  =  GraphDepth(X).  Assign  this  node  to  be  a  root  of  the 
tree.  Second,  remove  X\  from  the  graph  (this  does  not  mean  re-formulating  the 
optimization  problem  -  the  node  and  corresponding  edges  are  only  removed  from 
consideration  by  the  tree-building  algorithm).  For  every  connected  subgraph 
formed  after  the  removal  repeat  the  algorithm  recursively,  and  set  the  next- 
level  roots  to  be  children  of  X\  in  the  tree  ordering.  This  algorithm  can  be 
executed  by  running  the  locally  communicating  asynchronous  agents,  so  that 
every  agent  controls  one  node  (Fig.  2). 

The  result  of  the  algorithm  is  that  every  agent  knows  the  local  tree  infor¬ 
mation. 

Definition  3  Local  tree  information  for  agent  x  is 

•  ancestors  C  V,  an  ordered  set  such  that  ancestors [1]  is  the  root  of  the 
tree,  ancestorsfk]  is  the  parent  of  ancestors [k+1],  and  ancestors  [last]  is 
the  parent  of  x. 

•  children  C  V,  an  ordered  set  containing  all  the  children  of  x. 

•  ancestorsxroutes  C  N,  an  ordered  set  such  that  ancestorsjroutes[k]  is  the 
first  node  (not  counting  x  itself)  of  the  simple  path  from  x  to  ancestors[k] . 

•  ancestors-distances,  an  array  of  positive  integers  such  that  ancestors-distances [k] 
is  the  length  of  the  simple  path  from  x  to  ancestors[k[. 
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1:  receive  AgentDepth(xi,  X\x)  from  all  x%  €  N  except  one  Xk\ 

2:  send  AgentDepth(x,  X  \  Xk)  to  Xk', 

3:  receive  AgentDepth(xk ,  X\x)  from  Xk ; 

4:  send  Agent Depth(x,  X\xi)  to  all  Xi  £  N  \  Xk\ 

5:  send  AgentDepth(x,  X)  to  all  Xi  €  N; 

6:  receive  Agent Depth(xi,  X)  from  all  xt  £  N; 

7:  L  =  0; 

8:  while  \N\  >  0 

9:  if  Vxi  £  NAgentDepth{ x,X)  <  Agent  Depth(xi,  X) 

10:  send  ’’child  x”  to  ancestors  [last]  via  ancestors_routes[last]; 

11:  send  ’’ancestor  x,  distance  =  1”  to  all  Xi  £  N; 

12:  for  Vxj  £  N 

13:  receive  ” child  j/j” ; 

14:  append  yt  to  children; 

15:  append  Xi  to  children_routes; 

16:  end  for; 

17:  exit; 

18:  else 

19:  L  =  L  +  1; 

20:  receive  ’’ancestor  a,  distance  =  dist”  from  xa  £  N ; 

21:  append  a  to  ancestors; 

22:  append  xa  to  ancestors_routes; 

23:  append  dist  to  ancestors_distances; 

24:  send  ’’ancestor  a,  distance  =  dist+1”  to  all  Xi  £  N\xa\ 

25:  if  a  =  xa 

26:  remove  a  from  N; 

27:  else 

28:  receive  AgentDepth(xa,  Xl  \  x)  from  xa ; 

29:  receive  AgentDepth(xk,  Xl)  from  Xk', 

30:  send  AgentDepth(x,  Xl )  to  Xk ; 

31:  end  if; 

32:  send  AgentDepth{x ,  Xl  \  x^)  to  all  x^  £  N  \  x^, 

33:  send  AgentDepth(x,  Xl)  to  all  £  N  \  Xk ; 

34:  receive  AgentDepth(x,  Xl)  from  all  Xi  £  N  \  Xk', 

35:  end  if; 

36:  end  while; 

Figure  2:  Acyclic  graph  algorithm  for  agent  x 
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•  childreri-routes  C  N,  an  ordered  set  such  that  children-routes [k]  is  the  first 
node  (not  counting  x  itself)  of  the  simple  path  from  x  to  childrenfk] . 

On  line  (1:)  "all  xt  €  N  except  one  Xk”  means  that  an  agent  receives  \N\  —  1 
messages  from  its  neighbors,  and  the  remaining  agent  whose  message  was  not 
received  among  these  \N\  —  1  messages  is  denoted  x k-  The  receiver  does  not 
select  Xk  beforehand.  \N\  —  1  values  of  neighbors’  AgentDepth  are  enough 
to  compute  AgentDepthfx,  X  \xk),  and  x  does  that  without  waiting  for  the 
|7V|’th  value.  If  the  agents  were  to  wait  for  messages  from  all  their  neighbors, 
communication  would  never  be  started  and  they  all  would  be  locked  at  line  (1:). 

Every  cycle  iteration  agent  x  calculates  its  metric  AgentDepth  for  the  re¬ 
maining  subgraph  and  checks  if  it  is  the  minimal  value  within  that  subgraph 
(line  9:).  If  it  is,  and  the  tie  (if  there  is  one)  is  broken  in  this  agent’s  favor,  then 
it  becomes  a  node  of  depth  L  in  the  tree,  reports  this  fact  to  its  parent  (10:),  no¬ 
tifies  the  subgraphs  (11:),  waits  for  the  information  about  its  children  (12:-16:) 
and  exits  the  cycle.  Otherwise  it  increases  its  L  value  (19:),  receives  and  records 
the  information  about  the  next  ancestor  (20:-23:),  updates  the  AgentDepth  val¬ 
ues  that  might  change  (25:-34:),  and  repeats  the  process  for  a  smaller  subgraph. 

If  two  agents  have  the  same  AgentDepth  equal  to  a  minimum  value,  the  tie 
is  broken  in  favor  of  the  agent  which  is  closer  to  the  previous  level  ancestor.  It 
will  be  shown  further,  that  a  tie  between  more  than  two  agents  is  impossible, 
thus  the  tiebreaking  rule  can  always  be  employed,  except  for  the  first  iteration 
of  the  algorithm,  when  there  is  no  previous  ancestor.  In  the  latter  case  the  tie 
is  broken  using  agent  names. 

To  reduce  the  communication  load,  the  information  about  the  AgentDepth' s, 
which  cannot  change  with  the  removal  of  a  given  node,  is  not  communicated. 
This  means  that  instead  of  repeating  (l:-6:)  for  each  iteration,  agents  use  (28:- 
34:)  instead. 

2.2  Algorithm  Properties 

2.2.1  Correctness. 

The  following  two  theorems  show  that  for  a  given  agent  x  it  is  sufficient  to 
compare  its  AgentDepth  value  only  with  the  AgentDepth  values  of  x’s  neighbors 
to  find  out  whether  AgentDepth(x,  X)  =  GraphDepth(X) . 

Theorem  1  For  any  acyclic  graph  X,  if  there  are  2  nodes  x\  and  X2  such  that 
AgentDepth(x\,  X)  =  AgentDepth(x21  X)  =  GraphDepth(X) ,  then  X\  and  X2 
are  neighbors.  No  more  than  2  nodes  satisfy  the  requirement  AgentDepth(x ,  X)  = 
GraphDepth(X) . 

Proof:  First  observe  that  the  second  part  of  the  statement  follows  directly  from 
the  first  part  and  the  graph  being  ayclic.  Indeed,  if  there  are  3  or  more  nodes 
in  a  tie,  they  must  all  be  neighbors  with  each  other,  thus  forming  a  cycle. 

The  proof  of  the  first  part  is  as  follows:  suppose  dcci ,  £2  :  AgentDepth(x  i,X)  = 
AgentDepth(x2,  X)  =  GraphDepth(X)  and  xi,  x^ , . . . ,  Xik ,  X2  is  a  simple  path 
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from  X\  to  X2-  By  definition  of  AgentDepth , 


Agent  Dept  h(xi1}  X(V  \  aq))  <  AgentDepth{x\,X)  —  1  .  . 

AgentDepthfx^,  X{V \aq2))  <  AgentDepthfxi,  X)  —  dist(x2,Xi1) 

(note  that  Xi2  =  X2  is  possible),  and  because  (V  \  X\)  U  (V  \  Xi2)  =  V, 

AgentDepth(xi1 ,  *)< 

m&x{AgentDepth(xi,  X)  —  1,  Agent Depth(x\,  X)  —  dist(x2,Xi1  )}  (4) 

<  GraphDepth(X) , 

a  contradiction.  Therefore,  the  assumption  is  incorrect.  □ 


Theorem  2  For  any  acyclic  graph  X,  if  for  all  neighbors  Xi  of  a  given  node 
x  holds  AgentDepth(x,  X)  <  AgentDepth(xi,X),  then  AgentDepth{x,  X)  = 
GraphDepth(X) . 


Proof:  Suppose  AgentDepth( x,X)  >  GraphDepth(X) .  Let  xmin  be  the  node 
such  that  AgentDepth(xmin,  X)  =  GraphDepth(X ),  and  x,x± , . . .  ,Xk,xmin  is 
a  simple  path  from  x  to  xrnin .  By  definition  of  AgentDepth, 


AgentDepth{x\,  X (V  \  x))  <  AgentDepth(x,  X)  —  1 
AgentDepth(x\,  X (V  \  X2 ))  <  AgentDepth(xmin ,  X)  —  dist(xmin 
<  GraphDepth(X)  —  1  <  AgentDepthfx,  X)  —  1 

therefore, 

AgentDepth(xi,  X)  <  AgentDepth(x,  X)  —  1  => 

=>  AgentDepth(x\,  X)  <  AgentDepthfx,  X) 


xi)  < 


(5) 

(6) 


a  contradiction.  □ 

The  following  result  enables  one  to  think  of  the  graph  metric  GraphDepth(X) 
as  an  upper  bound  of  the  resulting  tree  depth. 


Theorem  3  For  any  acyclic  graph  X,  the  result  of  the  algorithm  execution  is  a 
tree  of  depth  no  greater  than  GraphDepth(X) 

Proof:  It  is  sufficient  to  prove  that  after  removal  of  node  x  such  that 
AgentDepthfx,  X)  =  GraphDepth(X ) 

any  of  the  resulting  connected  subgraphs  X,  has  GraphDepth(Xi)  <  GraphDepth(X)  — 
1.  The  number  of  subgraphs  is  equal  to  the  number  of  x’s  neighbors.  For  each 
neighbor  a of  x  ( Ni  is  the  set  of  xfs  neighbors  in  X) 

Agent Depth{xi,  Xf)  =  AgentDepth(xi,  X(V  \  x))  < 

<  AgentDepth{x,  X)  —  1  =  GraphDepth(X)  —  1, 

therefore  GraphDepth(Xi)  <  GraphDepthfX )  —  1.  □ 

The  next  result  shows  that  giving  up  the  requirement  of  parent  and  child 
being  neighbors  in  the  constraint  graph  does  not  lead  to  a  worse  solution  in 
terms  of  maximum  message  travel  time  from  root  to  leaves. 
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Theorem  4  For  any  acyclic  graph  X,  if  in  the  resulting  tree  x\  is  a  root,  Xi  is 
a  parent  of  Xi+ 1,  *  =  1,  fe  —  1,  Xfc  is  a  leaf,  then 


k- 1 

dist{xi,  Xi+i)  <  GraphDept.h(X) 

2—1 

Note  that  the  sum  under  consideration  is  the  number  of  ’Fops”  the  message  sent 
from  X\  to  Xk  encounters,  if  it  is  routed  th'ough  the  consecutive  descendants  of 
the  resulting  tree. 

Proof:  It  is  sufficient  to  prove  that  if  a:  is  a  root  of  the  tree  and  X\  is  its  child, 
then  Agent  Dept  h(x,  X)  >  dist{x,x\)  +  AgentDepth{x\,X{V  \  x)).  Suppose 
dist(x,x i)  +  AgentDepthfxi,  X (V  \  a:))  >  AgentDepth(x,  X).  There  exists  a 
simple  path  from  x  to  x±,  denote  it  x,  x*j , . . . ,  Xik ,  x\.  Because 

AgentDepthfxi,  X(V \xik))  <  AgentDepth(x,  X)  —  dist(x,x\),  (8) 

and 

AgentDepth{xik,  X(V  \{x,x\}))  <  Agent  Depthfxi,  X(V  \  x))  —  1,  (9) 

we  get 


AgentDepth(xik ,  *(na))  = 

=  max{(AgentDepth(xi,  X(V  \  x))  —  1),  Agent Depthfx,  X)  —  dist{x,x\)  +  1}  < 

<  AgentDepth{xi,  X{V  \x)) 


(10) 

and  because  dist(x ,  Xik )  <  dist(x,  a:i),  even  in  case  AgentDepth(xik ,  X(V\x))  = 
AgentDepth(x\,  X(V  \  a:)),  the  tiebreaking  rule  would  choose  Xik  over  X\  as  a 
root  for  the  subgraph,  therefore  the  assumption  is  impossible. □ 


Theorem  5  For  any  acyclic  graph  X  the  depth  of  the  resulting  tree  is  less  than 

\/W 

Proof:  Consider  a  resulting  tree  ordering  with  depth  h.  There  are  agents 
Xo,-.-,Xh  such  that  Xk  is  a  parent  of  Xk+i-  When  the  root  of  the  tree  was 


selected,  the  constraint  graph  was  divided  into  the  subgraph  X\  D  {xi, . . . ,  Xh} 
and  at  least  h  agents  not  contained  by  Xi .  The  proof  of  this  fact  is  as  follows. 
By  Theorem  3, 

Agent Depth{xo,  X)  >  h  (11) 

Let  xo,  Xjj , . . . ,  Xik ,  Xi  be  the  simple  path  from  Xo  to  xi.  Then 

AgentDepthfx ^ ,  X( V  \  x’o))  <  Agent Depthfx®,  X)  —  1  (12) 

If  the  assumption  |F(Xi)|  >  |P(X)|  —  h  holds,  then 

Agent Depthfa^ ,  X(V  \  ( N ^  \  Xq)))  <  h  (13) 
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Therefore,  from  (12)  and  (13) 


AgentDepth^x^,  X)  <  h—  1  <  AgentDepth(xo,  X)  (14) 

a  contradiction  with  AgentDepth{xo,  X)  =  GraphDepth(X),  and  the  assump¬ 
tion  |V(Xi)|  >  |y(Ai)|  —  h  is  wrong. 

Applying  this  reasoning  recursively,  conclude  that  the  total  number  of  nodes 
in  the  graph 

iF|>i  +  y>  =  i  +  Mi±i2  as) 

0 

therefore 

h  <  s/W\  (16) 

□ 

2.2.2  Complexity 

The  amount  of  memory  required  for  a  given  agent  x  is  0{\ IV |  +  h(X))  =  0(|AT|  + 
■y/l V|),  where  h  is  the  resulting  pseudo-tree  ordering  depth.  It  is  clear  from  the 
fact  that  the  agent  should  remember  the  information  about  its  ancestors  (there 
can  be  at  most  h{X)  —  1  of  them)  and  children  (at  most  |IV|).  Compared  to 
a  DFS  tree,  where  local  memory  cost  does  not  depend  on  the  total  number  of 
nodes  in  the  graph,  but  only  on  the  number  of  neighbors,  one  can  conclude  that 
in  our  algorithm  routing  memory  is  traded  off  for  the  tree  depth.  In  terms  of 
the  asymptotical  memory  requirement,  in  general  0(|1V|  +  ^/| V|)  is  equivalent 

to  o{  V )._ 

We  estimate  the  time  required  to  run  the  algorithm  using  the  popular  metric 
of  synchronous  cycles  [13].  A  cycle  is  defined  as  an  event  of  all  the  agents 
sending  all  the  messages  that  are  ready  and  receiving  all  the  messages  that 
were  sent  during  the  previous  cycle.  It  takes  0(GraphDepth(X))  =  0(|C|) 
cycles  to  propagate  the  nodes  metrics  information  along  the  graph.  Because 
the  information  about  paths  depths  is  reused,  after  selection  and  removal  of 
the  ancestor  node,  to  select  the  next  level  ancestor  one  needs  to  propagate  the 
information  about  the  ancestor  only  one  step  further  than  the  node  which  would 
be  the  next  level  ancestor,  which  requires  dist(ancestori,  ancestor i+i)  + 1  cycles 
and  the  same  number  of  cycles  to  propagate  the  child  information  back  to  the 
ancestor i  from  ancestor j+i.  Because 

^2  distianceston,  ancestor^)  <  GraphDepth(X),  (17) 

total  number  of  cycles  needed  is  0(GraphDepth{X ))  =  0(\V\). 

3  Limited-block  Case 

This  is  a  generalization  of  the  acyclic  case,  allowing  cycles  of  limited  size  to 
exist  in  the  constraint  graph. 


37:  m  =  receiveMessageQ;  prev  =  m.from;  append  x  to  m. stack; 

38:  for  i  =  l:|m.blocks| 

39:  if  ((m.blocks[i]  \  m.from)  n  neighbors  0) 

40:  for  k=m.blocks[i].top:|m.stack|  add  m.stack[k]  to  m.blocks[i]; 

41:  end  for;  end  if;  end  for; 

42:  for  i  =  l:(|m.stack|-2)  if  (m.stack[i]  £  neighbors) 

43:  for  k=i:|m.stack|  add  m.stack[k]  to  new_block;  end  for; 

44:  add  new_block  to  m. blocks;  break; 

45:  end  if;  end  for; 

46:  V  i^j:  (m.blocks[i]  H  m.blocks[j]  >  1)  merge(m.blocks[i],  nr.blocksfj]); 

47:  candidates  =  neighbors  \  ((U  nr. blocks)  U  nr. stack); 

48:  while  candidates  ^  0 

49:  if  (|m.stack|  +  JT  |m.blocks[i]|  >  MAX_BLOCK)  break;  end  if; 

50:  pick  next  €  candidates;  candidates  =  candidates  \  next; 

51:  send  m  to  next;  //go  one  step  deeper 

52:  mNew  =  receiveMessageQ;  //receive  control  back 

53:  (V  i:  mNew. blocks[i]. top  =  |nrNew.stack|)  remove  nrNew.blocks[i]; 

54:  if  nrNew. blocks  ^  m. blocks  //blocks  have  been  updated 

55:  add  next  to  BlockChildren;  parent  =  prev;  end  if; 

56:  m  =  nrNew;  candidates  =  candidates  \  ((U  nr. blocks)  U  m. stack); 

57:  end  while; 

58:  remove  nr.stack[last];  //un-append  this  agent 

59:  send  m  to  prev;  //return  control  up  one  level  in  DFS  tree 

Figure  3:  Block  discovery  algorithm  for  agent  x.  block.top  denotes  the  position 
of  the  highest  block’s  element  in  the  stack 


Definition  4  In  graph  theory  a  block  is  a  maximal  connected  subgraph  without 
a  cutvertex 1  [14] 

Each  block  is  either  an  isolated  vertex,  a  bridge  (two  vertices  and  an  edge 
between  them),  or  a  maximal  2-connected2  subgraph.  We  will  refer  to  only 
2-connected  subgraphs  as  blocks,  disregarding  the  first  two  degenerate  cases.  It 
is  known  [14]  that  two  blocks  intersect  in  at  most  one  vertex,  that  is  a  cutvertex 
of  the  graph. 

From  now  on  assume  that  the  maximum  block  size  in  the  constraint  graph 
is  k.  This  also  limits  the  maximum  simple  cycle  length  to  be  no  more  than  k. 

3.1  Algorithm  Overview 

The  algorithm  proceeds  in  two  major  stages.  During  preliminary  stage  each 
agent  discovers  its  block  configuration.  The  main  stage  is  the  iterative  process 

1  Cutvertex  is  a  vertex  that  separates  two  other  vertices  in  a  connected  subgraph 
2Graph  G  is  k-connected  iffVVi  C  V(G),  |Vi|  <  k  G  —  V\  is  connected  [14] 
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function  blocksOrder() 

60:  initAgentDepths(NC,  C); 

61:  while  (true) 

62:  if  (AgentDepth(x,  X)  <  AgentDcpth(:ri,  X)  Mx-i  G  NC  U  (U jCj)) 

63:  MakeMyselfRoot();  exit; 

64:  else  //I  am  not  a  new  root,  propagate  the  new  root  information 

65:  if  received  "child  y”,  forward  it  via  ancestors_routes[last];  end  if; 

66:  receive  list  from  y  G  N  ;  //list  of  newly-ordered  ancestors 

67:  append  list  to  ancestors;  set  ancestor  .routes  [a]  =  y  V  a  G  list; 

68:  if  (3 Ci  G  C  :  list [1]  G  Cf)  //I’m  in  the  same  block  as  root 

69:  orderUsingDFS(C'i,  list);  exit; 

70:  else  if  (3 Ci  G  C  :  ancestors_list[last]  G  Ci);  //not  in  the  same  block  as  root, 

71:  updateDepthsAndStructure^i,  list);  //but  block  configuration  has  changed 

72:  else  //not  a  root  and  block  configuration  hasn’t  changed 

73:  updateDepths(list); 

74:  end  if;  end  if;  end  while; 

end  blocksOrder; 

function  MakeMyselfRoot() 

80:  send  "child  x”  to  ancestors  [last]  via  ancestor  .routes  [last]; 

81:  send  list=[x]  to  NC  U  (Uvc^-ec  child(Cj)); 

82:  (for  VCy  G  C)  append  child(Cj)  to  children  and  children_routes;  end  for; 

83:  for  Vxi  G  NC 

84:  receive  "child  yf'  from  xp, 

85:  append  yi  to  children  and  Xi  to  children_routes; 

86:  end  for; 

end  MakeMyselfRoot; 

Figure  4:  Limited-block  algorithm  for  agent  x 

of  selecting  nodes  for  several  top  levels  of  the  hierarchy,  removing  them  from 
consideration  and  considering  resulting  subgraphs,  much  like  the  acyclic  case 
algorithm. 

3.2  Block  Discovery 

The  first  stage  of  the  algorithm  is  to  discover  the  block  configuration  of  every 
agent. 

Definition  5  Block  configuration  of  the  agent  x  is  the  following  data: 

•  A  set  NC  G  N  of  neighbors,  which  do  not  belong  to  the  same  block  as  x. 

•  A  setC  =  {Ci, . . .  ,Cfc}  of  blocks,  to  whichx  belongs.  Ci  =  { x ilt . . .  ,Xi]C]} 
(all  the  block  members  are  included,  not  only  the  neighbors  of  x) 

•  \/Xj  G  Ci\x  parent(xj)  G  N,  BlockChildren(xj )  C  N  -  the  parent  and 
children  of  x  in  the  DFS  spanning  tree  for  Ci  rooted  at  Xj . 
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•  VCj  child(Ci)  £  N  the  child  of  x  in  the  DFS  spanning  tree  for  Ci  rooted 
at  x.  (x  cannot  have  more  than  one  child  in  this  tree). 

This  information  can  be  obtained  using  the  multiple  distributed  depth- 
limited  (no  more  than  k+ 1)  DFS  traversals  of  the  constraint  graph,  one  traversal 
per  agent.  The  traversals  can  be  executed  in  parallel.  Fig.  3  contains  the  algo¬ 
rithm  pseudocode  (for  simplicity  the  algorithm  shown  is  for  only  one  traversal, 
started  in  a  pre-determined  agent).  It  performs  limited-depth  DFS  traversal 
with  currently  known  blocks  structure  (m. blocks)  included  in  every  message. 
Although  it  is  not  shown  in  the  code,  every  node  that  is  recorded  in  the  mes¬ 
sage  is  accompanied  by  its  depth  in  the  traversal  stack.  The  depth  in  the  stack 
is  equivalent  to  the  distance  of  the  given  node  from  root  within  a  block.  Every 
message  also  includes  current  stack  (m. stack)  of  the  traversal.  The  blocks  are 
merged  (46:)  whenever  it  is  possible  to  determine  that  two  blocks  in  a  message 
are  different  subsets  of  the  same  block.  If  a  block  is  found  not  to  contain  the 
root  of  the  traversal  (53:),  it  is  removed  from  the  message. 

Because  the  maximum  size  of  a  message  is  O(k)  (49:),  simultaneous  traversals 
require  no  more  than  Oink)  memory  on  each  agent. 

Definition  6  The  distance  between  X\,X2  £  X,  denoted  dist{x\,  X2,  X)  is  the 
length  of  the  simple  path  such  that  the  subpaths  between  neighboring  cutvertices 
xikixik+ i  are  selected  according  to  the  DFS  ordering  of  the  corresponding  block 
rooted  at  Xik 

Note  that  in  general  dist(xi,  Xj,  A)  ^  dist{xj,Xi,  A). 

3.3  Tree  Root  Selection 

Once  the  block  configuration  has  been  determined,  one  can  use  essentially  the 
same  iterative  algorithm  as  in  acyclic  case  to  construct  a  tree,  (see  Fig.  4,  5,  6 
and  the  following  definitions). 

We  assume  that  each  agent  has  a  prioritization  on  its  neighbors,  and  selects 
the  next  node  to  visit  in  a  DFS  traversal  (50:)  so  that  it  has  the  highest  priority 
among  all  the  available  neighbors.  Further  assume  that  this  prioritization  does 
not  change  over  time.  Position  of  a  node  in  a  list  of  neighbors  is  an  example  of 
such  prioritization. 

Definition  7  For  agent  x,  graph  X  and  set  NCS  C  NC{x,X),CS  C  C(x,  A)) 
AgentDepthfx,  NCS ,  CS,  A)  = 

max{0,  (AgentDepth(xi,  NCi  \  x,  C),  A)  +  1, \/xi  £  NCS),  ,  . 

{Agent Depth{xij ,  NC^ ,  C^  \Ct,  A)  +  dist{x,  Xi},X), 

Vxh  £  Ci\x,VCi  £  CS)} 

Definition  8  For  any  agent  x  £  X ,  where  X  is  a  connected  graph 

AgentDepth{x,  A)  =  AgentDepth{x,  NC{ x,  X),C(x,  A),  A)  (19) 


II 


function  initAgentDepths(NCU,  CU)  / /U  is  for  ’unknown’ 

90:  known  =  0; 

91:  while  |NCU|  +  |CU|  >  reported  +  1 

92:  receive  Agent  Depthfxi,  NC (xi)\x ,  C(xi) ,  X) ,  Xi  £  NCU;  known  =  known  +  1; 

93:  or  (receive  AgentDepth(xi,  NC(xi),C(xi )  \  Cj,X),  Xi  £  Cj  £  CU; 

94:  if  Mxi  from  Cj  have  reported,  known  =  known  +  1; 

95:  end  while; 

96:  unrep  =  Xi  £  NCU  with  AgentDepth  not  reported, 

97:  or  Cj  £  CU  with  not  all  AgentDepths  reported  in  the  previous  loop; 

98:  send  AgentDepth(x,NC  \  unrep,  C  \  unrep,  X)  to  unrep; 

99:  receive  AgentDepth (xt,  NCi  \  unrep,  Ci  \  unrep,  X)  from  Mxi  £  unrep; 

100:  send  AgentDepth(x,  NC  \xi,  C  \xi,  X)  to  all  Xi  £  (NC  UC)\  unrep; 

101:  send  AgentDepth(x,  X  )  to  Wxi  £  (NC  U  C); 

102:  receive  AgentDepth  (xi,  X)  from  Mxi  £  (NC  U  C); 
end  initAgentDepths; 

function  orderUsingDFS (Ci,  list) 

110:  append  x  to  list;  append  BlockCliildren(list[l])  to  children  and  children_routes; 

111:  send  list  to  BlockChildren(list[l])  U  (U c  ■  ec\Cichild(Cj))  U  NC; 

112:  for  \/xi  £  NC  U  C\Cp,  //get  remaining  children  information 

113:  receive  ’’child  yf’ ;  append  yt  to  children;  append  Xi  to  children_routes; 

end  for;  end  orderUsingDFS; 

Figure  5:  Limited  block  algorithm  subroutines 


function  updateDepthsAndStructure(Ci,  list) 

120:  send  list  to  BlockChildren(list[last])  U  (U Cjec\Cichild(Cj))  U  NC; 

121:  remove  Ci  from  C; 

122:  [newC,  newNC]  =  rebuildBlock(Ci\list[last]); 

123:  add  newC  to  C;  add  newNC  to  NC; 

124:  initAgentDepths  (newNC,  newC); 

end  updateDepthsAndStructure; 

function  updateDepths(list,  y) 

130:  if  3Cj  £  C  :  y  £  Cj 

131:  send  list  to  BlockChildren(y)  U  (Ucjec-.y^CjChil^Cj))  U  NC; 

132:  initAgentDepths(0,  Cj ); 

133:  else 

134:  send  list  to  (U Ci£Cchild(Ci))  U  (NC  \  y); 

135:  initAgentDepths(y,  0); 

end  if;  end  updateDepths; 

Figure  6:  Limited  block  algorithm  subroutines 
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Figure  7:  Limited-block  example.  Ellipses  denote  blocks,  solid  circles  -  agents, 
solid  lines  -  ordering  relationships,  dotted  lines  -  edges  of  the  constraint  graph 


Definition  9  For  any  block  C  in  graph  X 

Block Depth(C ,  X)  =  min  AgentDepth{x1  X)  (20) 

Definition  10  For  constraint  graph  X 

GraphDepth(X)  =  min  AgentDepth{x,  X)  (21) 

x£X 

The  algorithm  proceeds  as  follows.  First,  like  in  the  acyclic  case,  the  agents 
exchange  messages  to  compute  their  own  and  their  neighbors’  AgentDepths 
(60:).  After  this  step  is  complete,  the  agent  with  the  smallest  depth  value  be¬ 
comes  the  root  for  the  current  connected  subgraph.  Depending  on  their  position 
relative  to  the  root,  other  agents  take  different  actions.  Fig.  7  presents  an  ex¬ 
ample  of  the  possible  situations  an  agent  can  find  itself  in.  Suppose  agent  a  was 
chosen  to  be  the  root  (62:-63:).  To  announce  that  it  sends  a  message  to  its  par¬ 
ent  in  the  ordering  (80:),  and  messages  to  its  neighbors  that  are  not  in  the  same 
block,  and  to  DFS  children  in  the  blocks  (81:).  To  propagate  this  information 
for  all  the  subgraphs,  other  agents  forward  these  messages  as  necessary  (65:, 
111:,  120:,  131:,  134:).  After  sending  its  messages,  a  waits  for  the  information 
about  the  children  that  it  does  not  know  about  yet  (83:-86:)  and  then  exits. 

Agents  in  the  same  block  as  root  (68:)  are  ordered  according  to  the  DFS 
ordering  of  that  block  (69:,  82:,  110:-113:).  For  example,  agent  b  is  in  the  same 
block  as  a  and  gets  its  ordering  according  to  the  DFS  spanning  tree  for  that 
block  rooted  at  a.  Solid  lines  in  Fig.  7  denote  that  clusters  A  and  B  become 
ordered  according  to  DFS  trees  rooted  at  a. 

Agents  not  in  the  same  block  as  root,  but  in  the  same  block  as  some  other 
agent  that  becomes  ordered  (such  as  c  that  is  in  the  same  block  as  b,  but  not 
in  the  same  block  as  a)  (70:-71:)  need  to  rediscover  their  block  configuration, 
because  after  removal  of  a  node  the  block  may  split  in  several  blocks  or  even 
disappear  alogether.  The  rediscovery  is  performed  by  the  same  function  as  the 
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Figure  8:  Simple-cycle  and  fully  connected  blocks 


initial  block  information  discovery,  but  restricted  to  agents  of  one  block  (122:- 
123:).  For  example,  c  restricts  its  effort  to  the  agents  in  cluster  C  and  does  not 
attempt  a  new  DFS  traversal  in  the  direction  of  node  d.  This  is  achieved  by 
using  neighbors  fl  (C)\ list  [last])  instead  of  just  neighbors  on  line  (46:)  of  the 
block  discovery  procedure. 

The  rest  of  the  agents,  those  not  in  the  same  blocks  with  the  newly-ordered 
nodes  (72:-73:)  (e.g.  d,  e,  /)  only  need  to  forward  the  information  about  the 
new  ancestors  (131:,  134:)  and  update  the  relevant  part  of  their  AgentDepths 
(132:,  135:).  Then  all  the  remaining  agents  participate  in  the  next  iteration  of 
the  ordering  process. 

An  alternative  to  ordering  the  blocks  that  contain  the  root  in  a  DFS  man¬ 
ner  would  be  to  remove  only  root  from  consideration,  rebuild  the  corresponding 
blocks  and  proceed  to  the  next  iteration.  Either  aproach  can  be  used  depending 
on  how  densely  the  nodes  are  connected  inside  blocks.  If  inside-block  connec¬ 
tivity  is  sparse,  the  latter  method  is  preferable,  because  it  has  a  high  chance  of 
discovering  a  tree  of  smaller  depth  than  any  of  the  DFS  spanning  trees  for  this 
block.  Otherwise  the  former  method  should  be  used,  because  it  is  faster  and 
improvements  over  DFS  are  unlikely.  Fig.  8  illustrates  this  idea  with  two  ex¬ 
treme  cases  of  inside-block  connectivity:  fully-connected  block  and  simple-cycle 
block.  From  now  on  assume  that  the  former  approach  (ordering  whole  clusters 
at  once)  is  chosen. 

3.4  Algorithm  Properties 

The  following  results  show  that  for  each  iteration  every  agent  can  conclude 
whether  it  is  a  a  root  in  a  subgraph  using  only  information  about  its  neighbors 
and  blocks  it  belongs  to. 

Theorem  6  If  X  is  a  connected  graph  and  there  are  2  nodes  Xi,Xj  £  X  such 
that  AgentDepth(xi,  X )  =  AgentDepthfxj ,  X )  =  depth(X),  then  Xi  and  Xj  are 
either  neighbors  or  belong  to  the  same  block. 

Proof:  The  proof  by  contradiction  is  similar  to  the  acyclic  case.  Suppose 
AgentDepthf  x±,X)  =  AgentDepth(xn,  X)  =  depth(X),  and  X\  and  xn  are  not 
neighbors  and  do  not  belong  to  the  same  block.  It  means  that  there  is  a  simple 
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path  from  x\  to  X2,  denote  it  X\ ,  X2,  ■■■,  xn~i ,  xn,  and  at  least  one  of  the 
nodes  on  this  path,  Xi,  separates  X\  and  X2 ■  Suppose  that  x^  and  Xi-\  belong 
to  the  same  block  Cix ,  and  Xi  and  Xi+\  do  not  belong  to  the  same  block  (other 
3  possible  cases  have  proofs  that  differ  very  little  from  this  case). 

By  definition, 

AgentDepth{xi,  X)  >  dist(x\,Xi,X)  +  Agent Depth(xi,  NCi,Ci  \Cil,X) 
Agent  Depth{xn ,  X)  >  dist(xn,  X)  +  AgentDepth(xi,  NCi  \  Xi+i,  Ci,  X) 

(22) 

but  then 

AgentDepth(xi,  X)  = 

max{AgentDepth(xi,  NCCi  \  C ,  X),  Agent Depth(xi,  NCi  \  Xi+ 1,  Ci,  X)}  < 

<  GraphDepth(X) 

(23) 

which  is  a  contradiction  and  shows  that  the  assumption  is  wrong.  □ 


Theorem  7  If  X  is  a  connected  graph,  and  for  all  neighbors  x i  £  NC  and 
blocks  Cj  £  C  of  a  given  node  x  holds 

AgentDepth(x,  X)  <  AgentDepth(xi,  X)  (24) 

AgentDepthfx,  X)  <  BlockDepth(Cj,  X)  (25) 

then  AgentDepth(x)  =  GraphDepth(X ). 


Proof:  Again,  the  proof  by  contradiction  is  similar  to  the  acyclic  case.  Suppose 
AgentDepth{xi,  X)  >  AgentDepth(xn,  X)  =  depth(X),  and 


\/Xi£NC\  AgentDepthfxi,  X)  <  AgentDepthfaii,  X)  .  . 

VCi3.  £  C\  AgentDepthfxi,  X)  <  BlockDepth^Ci^X) 

There  is  a  simple  path  from  x±  to  X2,  denote  it  X\,  X2,  ■  ■  ■ ,  xn_\,  xn,  and  at 
least  one  of  the  nodes  on  this  path,  separates  x±  and  X2 ■  Denote  Xi  the  first 
such  node  on  the  path  from  x\  to  xn.  It  is  either  a  neighbor  of  X\  or  belongs 
to  the  same  block  with  x\.  Suppose  that  Xi  and  Xi- 1  belong  to  the  same  block 
,  and  Xi  and  Xi+\  do  not  belong  to  the  same  block  (other  3  possible  cases 
have  proofs  that  differ  very  little  from  this  case). 

By  definition, 

AgentDepthfxi,  X)  >  dist(x\,Xi)  +  AgentDepth(xi,  NCi,  Ci  \  C ^ ,  X) 
AgentDepth{xn ,  X)  >  dist(xn,  Xi)  +  AgentDepth{xi,  NCi  \  Xi+ 1,  Ci,  X) 

(27) 

but  then 


Agent  Dept  h(x  i,  X )  = 

man{ AgentDepth(xi,  NCi,  Ci  \  Ci1,X),AgentDepth(xi,NCi  \  Xi+i,  Ci,  X)}  < 

<  max{AgentDepth(xi,  X)  —  dist(xi,Xi),  Agent Depth(xn,  X )  —  dist(xn,Xi)} 

(28) 

that  is  either  AgentDepthfxi,  X)  <  AgentDepth(x\,X)  (a  contradiction  with  (26)), 
or  AgentDepthfxi,  X)  <  Agent Depth(xn,  X)  =  GraphDepth(X)  (a  contradic¬ 
tion  with  Graph  Depth  definition).  □ 
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Theorem  8  If  X  is  a  connected  graph,  the  result  of  the  algorithm  execution  is 
a  tree  of  depth  no  greater  than  GraphDepth(X) 

Proof:  It  is  sufficient  to  prove  that  after  removing  a  node  x  and  its  blocks  from 
graph  X  for  all  the  resulting  connected  subgraphs  X, 

GraphDepth(Xi)  <  AgentDepthfx,  X)  —  I  (29) 

Because  \/xi  €  NC  0  Xi 


AgentDepth(xi,  Xj)  = 

=  AgentDepthfxi ,  NC(xi ,  X)  \  x,  C(xi,  X),  X)  <  AgentDepth(x,  X)  —  1, 

(30) 

and  the  theorem  statement  holds  for  all  the  subgraphs  such  that  X,  n  NC  ^  0. 

For  subgraphs  Xj  that  were  connected  to  one  of  the  removed  blocks  C.-,, 
denote  y,:  the  node  separating  Xj  from  x. 

AgentDepth(yi,  Xi)  <  AgentDepthfx,  X)  —  dist(x,Xi)  . 

GraphDepth(Xi)  <  GrapthDepth(x,X)  —  dist(x,Xi)  ' 

that  concludes  the  proof.  □ 

Theorem  9  For  any  connected  graph  X  the  depth  of  the  resulting  tree  is  less 
than  \j2k\V\,  where  k  is  the  maximum  block  size. 

The  proof  is  analogous  to  the  acyclic  case,  given  the  observation  that  after 
removal  of  a  block  from  the  graph  there  will  remain  a  subgraph  Xj  such  that 
GraphDepth{Xi)  >  GraphDepth(X)  —  k.  □ 

3.5  Complexity 

Estimate  memory  requirements.  Parallel  DFS  search  can  require  space  up  to 
0(nk)  (n  threads  with  k-long  depth).  Block  of  size  l  requires  0(1 2)  space, 
thus  information  about  all  the  blocks  takes  up  to  0(k2j)  =  0(nk).  Ancestors 
information  O(Vnk),  and  children  information  0(n).  Therefore,  the  worst-case 
memory  complexity  of  the  algorithm  is  0(nk). 

The  time  complexity  of  the  algorithm  (again,  in  synchronous  cycles)  is  0(n+ 
\E\  +  k^ni),  where  E  is  the  number  of  edges  in  the  constraint  graph.  The  proof 
is  as  follows.  The  initial  block  discovery  stage  takes  up  to  0(n  +  \E\)  time  all 
the  DFS  traversals  are  executed  simultaneously.  The  initial  depth  information 
propagation  takes  up  to  0(GraphDepth(X ))  =  0(n).  If  x  is  the  root  of  the 
tree,  x±  is  its  child,  then  it  is  enough  to  propagate  the  depth  information  for  a 
distance  of  dist(x,x i)  +  k  before  x\  can  make  a  decision  to  become  x's  child. 
Block  rediscovery  also  takes  no  more  than  O(k)  cycles  per  iteration.  Because 
the  maximum  pseudo-tree  depth  is  0(\/kn),  this  adds  the  O(k^n^)  term. 
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Acyclic  case  -  ordering  cost 


Acyclic  case  -  ordering  cost 


Limited-block  case  -  ordering  cost  Limited-block  case  -  ordering  cost 


Figure  9:  Ordering  costs  for  acyclic  (top  row)  and  limited-block  (bottom  row) 
cases 

4  Evaluation 

The  experimental  evaluation  consists  of  two  parts.  The  first  part  is  the  com¬ 
putational  and  communicational  cost  of  running  the  oredring  algorithm  itself. 
The  second  part  shows  how  the  ADOPT  algorithm  performs  with  pseudotree 
ordering  compared  to  DFS  ordering. 


4.1  Ordering  algorithm  cost 

The  experimental  measurements  of  the  pseudo-tree  ordering  cost  are  summa¬ 
rized  in  Fig.  9.  Limited-block  case  experiments  were  conducted  for  50  agents, 
branching  factor  1.7  and  intra-cluster  link  density  0.5,  varying  only  maximum 
cluster  size.  The  algorithm  was  implemented  using  RETSINA  [15]  multiagent 
framework  for  message  passing  between  agents.  The  time  results  were  obtained 
on  a  single  3GHz  Pentim  4  computer  with  1GB  of  RAM.  It  was  found  that  most 
of  the  computational  resources  was  spent  on  parsing  KQML  messages. 
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acyclic,  50  vars,  constraint  density  0.4 


acyclic,  50  vars,  branch  factor  1.8 


Figure  10:  ADOPT  performance  using  DFS  and  pseudotree  orderings.  Acyclic 
constraint  graphs  (top  row)  and  limited-block  case  (bottom  row) 

4.2  ADOPT  performance 

We  provide  a  comparison  of  the  performance  of  ADOPT  algorithm  using  DFS 
and  pseudotree  ordering  of  the  variables  (Fig.  10).  We  used  only  the  algorithm 
runtime  as  a  measure  of  performance,  because  communicational  cost  is  linearly 
proportional  to  the  runtime.  Experiments  with  ADOPT  were  performed  using 
agents  running  on  3  networked  computers.  Branching  factor  of  the  constraint 
tree  (meta-tree  in  case  of  limited-block  graphs)  and  average  constraint  tightness 
(fraction  of  the  variables  assignments  that  cause  constraint  violation)  were  var¬ 
ied.  One  can  conclude  that  while  neither  ordering  method  dominates  another 
for  all  types  of  problem  structure,  pseudotree  ordering  results  in  much  faster 
DCOP  solutions  for  problems  with  low  constraint  tightness. 


5  Conclusion 

We  have  presented  a  new  algorithm  for  variable  ordering,  which  allows  to  elim¬ 
inate  the  need  to  process  global  information  when  solving  a  DCOP.  It  also  in- 


18 


creases  the  solution  search  efficiency  by  exploiting  the  problem  structure  when 
possible.  This  extends  the  class  of  problems  for  which  employing  ADOPT  is 
feasible  and  allows  to  apply  it  to  completely  decenralized  problems.  The  algo¬ 
rithm  has  provable  theoretical  guarantee  on  the  resulting  ordering  depth  and 
polynomial  time  and  space  complexity. 
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